(19) 



J 



Europslsches Pstentamt 
European Patent Office 
Office europeen dee brevets 




(12) 



(45) Date of publication and mention 
of the grant of the patent: 
28.11.2001 Bulletin 2001/48 

(21) Application number 94304216.8 

(22) Date of filing: 10.06.1994 



(ID EP 0 637 744 B1 

EUROPEAN PATENT SPECIFICATION 

(51) intct.7: G01N 21/82, G01N 15/05 



(54) Method for classifying agglutination reactions 

Verfahren zum Klasslfizieren von Agglutinarjorareaktionen 
M6thode pour classifier des reactions d'agglutination 



(84) Designated Contracting States: 

BE CH DE DK ES FR GB IT LI LU NL SE 

(30) Priority: 11.06.1993 US 75302 

(43) Date of publication of application: 
Oa.02.1995 Bulletin 1995/06 

(73) Proprietor ORTHO DIAGNOSTIC SYSTEMS, INC. 
Rarltan, New Jersey 08869-0608 (US) 

(72) Inventors: 

• Shen, J Ian 
Somerset, N J 08873 (US) 

• Yaremko, My kola 
Livingston, NJ 07039 (US) 

• ChachowsM, Rosemary 
Manvllle, NJ 08835 (US) 

• Atzler, Josef 
A-5400 Halteln (AT) 



ffl 

s 

N 
CO 
<D 

O 

CL 
LU 



• Duplnet, Thierry 
CH-8708 Maennedorf (CH) 

• Ktttrfch, Daniel 
16000Praha8(CZ) 

• Kunz, Hansjoerg 
CH-8032 Zurich (CH) 

• Puchegger, Karl 
A-5020 Salzburg (AT) 

• Rohrfs, Reiner 
D-83395 Frellasslng (DE) 

(74) Representative: Mercer, Christopher Paul et aJ 
Carpmaels & Ranstbrd 
43, Blooms bury Square 
London WC1A2RA (GB) 



(56) References cited: 
EP-A- 0 342 730 
GB-A-2 017 910 



DE-A-4023156 
US-A- 4 563 430 



Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give 
notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in 
a written reasoned statement, it shall not be deemed to have been filed until the opposition fee has been paid. (Art. 
99(1) European Patent Convention). 



Printed by Jouue, 75001 PARIS (FR) 



EP0637744B1 



Description 

BACKGROUND OF THE INVENTION 

5 [0001] This invention generally relates to a method and system for the detection and quantification of agglutinates 
formed in response to Immunological agglutination reactions, and more particularly, to such a method and system 
employing automated Image and data processing means to automatically detect and classify agglutination patterns. 
[0002] Immunological agglutination reactions are used for identifying various kinds of blood types and for detecting 
various kinds of anttoodies and antigens in blood samples and other aqueous solutions. In a conventional procedure, 

io a sample of red blood cells is mixed with serum or plasma In test tubes or mteroplates, and the mixture may then be 
incubated and centrif uged. Various reactions either occur or do not occur depending on, for example, the blood type 
of the red blood cells or whether certain antibodies are present in the blood sample. Typically, these reactions manifest 
themselves as clumps of ceils or particles with antigens and antibodies on their surfaces, referred to as agglutinates. 
Thus, the absence of any such clumps indicates that no reaction has occurred; and the presence of such clumps 
indicates that a reaction has occurred, with the size and amount of such clumps being a quantitative indicator of the 
level or concentration in the sample, or an indicator of the reaction strength, affinity of the complex for which the blood 
sample was tested. 

[0003] Recently, a new agglutination test method -referred to as column agglutination technology, or CAT- has been 
developed. Column Agglutination Technology may be defined as the analysis of blood and blood products utilizing 

20 filtration as a means of separating agglutinated, precipitated, absorbed, or adsorbed particulate components from non- 
reactive components for Immunoassay applications. In this method, gel or glass bead microparticles are contained 
within a small column, referred to as a microcolumn. A reagent such as anti-IgG is dispensed in a diluent In the micro- 
column and test red blood cells are placed in a reaction chamber above the column. The column, which is typically 
one of a multitude of columns formed in a transparent cassette, is centrifuged. The centrifuging accelerates the reaction, 

25 if any, between the reagent and the biood cells, and also urges the cells toward the bottom of the column. The glass 
beads or gel in the microcolumn act as a filter, however, and resist or Impede downward movement of the particles in 
the column. As a result, the nature and distribution of the particles in the microcolumn after centrifuging provides a 
visual indication of whether any agglutination reaction occurred in the microcolumn, and If so, of the strength of that 
reaction. 

ao p004] in particular, if no agglutination reaction occurs, then al! or virtually all of the red blood cells in me microcolumn 
pass downward, during centrifuging, to the bottom of the column and form a pellet at that bottom. If there is a very 
strong reaction between the reagent and the red blood ceils, virtually all of the red blood cells agglutinate, and large 
agglutinates form at the top of the microcolumn , above the gel or glass beads contained therein . Th e gel or glass beads 
prevent the agglutinates from passing, during centrifuging, to the bottom of the column, so that after centrifuging the 

& agglutinates remain above the gel or beads. 

[0005] If there Is a reaction between the reagent and the blood cells, but this reaction is not as strong as the above- 
described very strong reaction, then some but not all of the red blood cells agglutinate. "The percentage of red blood 
cells that agglutinate and the size of the agglutinated panicles both vary directly with the strength of the reaction. During 
centrifuging, the unreacted blood ceils pass to the bottom of the column, and the distance that the agglutinated particles 
pass downward through the column depends on the size and number of those particles. Hence, the size of the pellet 
of red blood cells at the bottom of the microcolumn, and the extent to which the agglutinates penetrate into the gel or 
glass beads in the microcolumn, are both inversely related to the strength of the reaction between the reagent and the 
red blood ceils. 

[0006] With this CAT, after the desired processing steps have been performed, the microcolumn is observed, or read, 
45 by a human operator, who then classifies the reaction between the reagent and the red blood cells. Conventionally, 
the reaction is classified as either negative or positive; and if positive, the reaction is then further classified into one of 
four classes depending on the strength of the reaction. A highly skilled operator is needed to properly read and classify 
tne reaction. 

SO SUMMARY OF THE INVENTION 

[0007] An object of this invention is to automatically analyze aqueous solutions for agglutination patterns. 
[0008] Another object of the present invention is to automatically read and classify agglutination reactions between 
red blood cell antigens and antibodies. 
& [0009] A further object of this invention is to produce an image of a blood sample and to analyze that image using 
high speed image and data processing equipment to determine If the blood sample contains an agglutination pattern 
and, if so, to classify that pattern. 

[001 0] A still another object of the present invention is to provide a method for automatically reading and classifying 
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agglutination reactions that occur in a column having a microfifter that produces different agglutination patterns de- 
pending on the strength of that reaction. 

[0011] A further object of this invention Is to provide an accurate, high speed method and system for automatically 
reading and classifying red blood cell agglutination reactions, 

[0012] These and other objectives are attained with a method for analyzing a solution for an agglutination pattern. 
The method comprises the steps of producing an illuminated Image of the solution on an array of pixels, and assigning 
to each pixel in the illuminated image, a data value representing the Intensity of the illuminated Image on the pixel. 
These data values are then processed according to a predetermined program to determine if an agglutination pattern 
is present and, if so, Id classify that pattern into one of a plurality of predefined classes. With the preferred processing 
procedure, the pixel array is separated Into a plurality of zones, and the data values for the pixels In each zone are 
processed according to a respective predetermined procedure to determine values for a predefined set of variables. 
Then, those determined values are processed to determined whether an agglutination pattern is present In the solution, 
and if so, to classify that pattern into one of the predefined classes. 

[0013] With the preferred embodiment of the invention disclosed herein in detail, the solutions are contained In a 
column having glass mterobeads. The Image processing program searches the location of the column in the source 
Image on the pixel array; and after the column is located, the program generates a window to cover the column where 
the red cells are located. The program then selects three reference regions from inside and outside the column and 
measures the Intensity or gray levels In these regions, and these measured gray levels are used to determine certain 
threshold values that are subsequently used in the processing program. 

[001 4] The cell pellet is extracted by applying global threshold values in a V-shaped, lower portion of the column, 
and parameters related to the shape of the cell pellet are also calculated. The program then generates a fixed mask 
to cover the bead area in the column. 

[001 5] For the feature calculation, the bead column is divided into five different zones. The region on top of the bead 
column is defined as the positive zone, the region at the bottom of the column is defined as the negative zone, and 
the area between the positive and negative zones is separated into three intermediate zones. The red cells located in 
the positive zones are extracted using a threshold method, and the red cell agglutinates located in the intermediate 
zones are extracted using a morphological filter. In addition, the balance of the red cells between the left and right 
sides of the column is determined. For each column, the above parameters are preferably calculated for both front and 
back side images of the column, and the two calculated values for each parameter are combined. The agglutination 
reaction is then classified on the basis of these combined features. 

[0016] Further benefits and advantages of the invention will become apparent from a consideration of the following 
detailed description given with reference to the accompanying drawings, which specify and show preferred embodi- 
ments of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 7] Figure 1 is a schematic diagram of an automated blood analysis system embodying the present Invention. 
[00181 Figure 2 is a block diagram illustrating several components of the system of Figure 1 . 
[0019] Figure 3 is a front view of a solution cassette that may be used in the system of Figure 1 . 
[0020] Figure 4 is a side view of the cassette. 
[0021] Figure 5 Is a top view of the cassette. 

[0022] Figure 6A shows a glass pattern that may be used to focus the camera of the system shown in Figure 1 . 
[0023] Rgures 6B and 6C show two pattern signals that may be produced on the camera using the glass pattern of 
Figure 6A, depending on whether the camera is in focus or out of focus. 

[Q024] Figure 7 is a more detailed drawing of the processing subsystem of the analysis system of Figure 1 . 
[0025] Figure 6 schematically illustrates the memory board of the rnage processes of the processing subsystem. 
[0026] Figure 9 is a front view of the transport subsystem of the analysis system shown in Figure 1 . 
P>027] Figure 1 0 illustrates the transport subsystem in the analysis system. 

[0028] Figures 11A-11E show different agglutination patterns that may be produced in acolumn of the cassette shown 
in Figures 3-5. 

[0029] Figure 1 2 generally outlines the preferred procedure for processing the image data produced in the system 
of Figure 1. 

[0030] Figure 13 illustrates one step in identifying the locations of the rnage of the columns In the pixel array of 
Figure 1 . 

[0031] Figure 1 4 illustrates a step in Identifying the edges of a column image. 

[0032] Figure 15 shows various reference areas on the pixel array that are used to determine a set of reference 
values. 

[0033] Figure 1 6 shows a pellet of red blood cells at the bottom of a column. 
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IP034] Figure 1 7 shows a mask used in the Image processing. 

I 0035 ] Figure 1 8 illustrates the column separated Into multiple zones. 

PM36J Figure 1 8 illustrates the results of a top-hat transformation to a line slice of an frnage 

KLlumlT 20 8h0W8 thetWOpart3of tte column used to determine the balance of the red blood cell agglutinates 

P»38] Rgure 21 is a different version of the Decision Tree. 

DETAILED DESCRIPTtOM OF THE PREFERRED EMBODIMENTS 

EJTn 91 " 88 1 ,T d 2 "! U8tr8te aUt0mated ^ ^'"9 ■>»■"" 10. generally, comprising holding means 12. 
nh«ninatton means 14, imaging subsystem 16,andprocessingsubsystem20; and preferably system 10 further includes 
fransport subsystem 22. storage means 24. waste receptacle 26. and bar code reader 30. With the embodiment of 
system 10 shown In Figure 1. holding means 12 Includes base 32 and frame 34; and illumination means Includes a 
pairof nuorescencelighte36aand36b. diffused, and neutral density filter 40. Imaging subsystem 16 Includes pixel 
array 42, housing 44 and lens assembly 46; and this tens assembly, in turn, includes lens 50. filter 52, and lens housing 

S;^l e R? e ^ Pr! T S, T UbSyStem 20 inchJdes Processors* main processor 60, and Input means such 
askeyboard 82; and the preferred transport subsystem 22 shown In Rgure 1 includes support means 64 and mover 66 
BXM0] Generally, holding means 12 is provided to hold a test sample for analysis, and Illumination means 14 is 
provided to produce an illuminated Image of the test sample on Imaging subsystem 16. Subsystem 1 6 generates a set 
ofsfcjnab representing the illuminated image formed thereon and then transmits thoseslgnals to processing subsystem 
20. The processing subsystem receives those signals from subsystem 16 and processes those signals according to 
fJTr^I! !L P H^ m 10 determ,ne *"*"«• an agglutination pattern is present in a test sample being analyzed 
and, if so, to classify that pattern in one of a plurality of predefined classes 

[0041] The preferred embodiment of system 10 described herein in detail is particularly well suited for analyzing 

SL°^^KT^ t i amP ' e ! ^ 10 M SOlUtk5n8 ' " Sh0uld 06 noted * B >™entlon may 

i ftat ?W ° ther materia,s - inc,udin 9 other *W G0US solans such as urine. It is not nec- 

I' I? matWlal bei " 9 analy2ed be 8 "P-"* orafluid ! an °\ the term ■solution' as used herein is 
used in the general sense as any mixture of liquid, gaseous, or solid substances. 

PM21 In addition the test samples analyzed in system 10 are preferably held within containers, and a large variety 
tTZZllT* !^ TT 1 " ** 10 - H0W9Ver ' » e P^ 6 ™* embodiment of system 10 da- 

^^^1 ? *!? rtfCU,arty *" for Use co^ta,ne,8 ofthetypeshownat80inRgures3,4,and5. 
oTri^^L r ^ ,r ! d J^? aSSette f * Bramadefroma ^^^t, integrally molded plastic material. A multitude 
of cavities or wells 82, referred to as columns or microcolumns, are formed in the cassettes and extend downward 

[004^Amultrtode of very small, transparent glass beads, having diameters ontheoiderof magnitude of 10 to 100 
ZZTT" ? ep ° Sited ,n and formafl,terln the 'ower portion of each microcolumn. Alternately, the lower portion 
of each microcolumn may be provided with a suitable gel that functions In the same general way as the mlcrobeads 
m ,!L P ^ dtepen8ed in the v*"™* °* ^ calotte; and after the columns of the cassette are provided 
columns 8? MlmM ^' 8 f °" 84 18 S80Ured on » e te P ot the cassette to cover and 0^0*0^ 

PJM4J When any particular cassette 60 Is used. one. some, or all of the microcolumns 62 in the cassette may be 
£7L .ZT*'' 08888110 may Deusedw,tn btooa sar "P'« from one or more individuals. In each microcolumn 
m^S^n 3 ^^ .Si* 0011 "f*™* 0 " 0 ™ more rea 3 e ^ that react with known agents are pipetted Into the 
25T?£^? - 8anipl6 ' thB prBSence " 1081 one or '"ore agents. The cassette may be incubated 
TJ^S^T^T^. WWCh T. 0 ' 000 * 8ample 18 06,09 tested " * P^nt in the microcolumn, the 
■ W °° d 06,18 10 f0m "Xtrin*** and the number, size, and distribution of the agglutinates in 
the microcolumn is an indication of the strength of that reaction. 

[00451 With reference again to Figure 1 , frame 34 of holding means 12 forms an elongated channel 34a for holding 
e^rSSr 5 h f 808886 ^ 8 °: and preferably, as shown in Rgure 1, the longitudinal ends of the channel 34a are 

ZZE^Z^T?" °" ba883Z fW PlVOtal "^^ntaboutacerrtralverlkalaxis.andamotor 
b connected to frame 34 to pivot or rotate the frame about that axis 

KZ Z"^" 1!T S J 4, . ¥, ' hiCh Pr8f8,ab,y ^P^ 68 a P* ^ fluorescence lamps 36a and 36b, directs light 
lT£IS2f ! i d ' n ,rame34and onto imaflin « 8Ub8 y 8tem 16 > flnd specifically onto pixel array 42, which 
j!^; n a * 8rie8 J ^ representing the test sample. More particularly, pixel array 42 is disposed inside a 
camera housing 44. and the pixel array is preferably comprised of a multitude of light sensors each of which is capable 

L^,S a t reS ° ^ tlf* 10 ° urrent havln8 a m^nitude proportional to or representing the Intensity of light 
incident on that sensor. Preferably, these light sensors, or pixels, are arranged In a uniform grid of a given numberof 
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uniformly spaced rows and columns. 

[0047] With reference again to Figure 2, lens 50 and filter 52 are located forward of pixel array 42 and are coaxial iy 
aligned with each other and with the pixel array, and lens 50 is positioned so that the pixel array is at the back focal 
plane of this lens. Preferably, lens 50 and filter 52 are mounted inside housing 54, which In turn is mounted on the front 
end of camera 44. 

[0048] As will be understood by those of ordinary skill in the art, any suitable light source 1 4, lens 50, filter 52, and 
camera 44 may be used in system 10. For example, in an embodiment of system 10 that has been actually reduced 
to practice, camera 44 is a Sony XC-75CE video camera, and the pixel array or sensoring element in this camera Is a 
charged coupled device (CCD) comprising a matrix of pixels in a rectangular array, 752 pixels by 582 pixels. TTte 
distance between the camera and the cassette held in frame 34 was adjusted so that each image on the pixel array 
contains two columns 82 of the cassette, and the width of each column In the image is about 152 pixels. 
[0049] A Componon mlcrolens manufactured by Schneider Corporation was set at an F stop of F/4.0 and attached 
on the camera via an adaptor. Between the lens and the CCD element was fixed a band pass filter with a center 
wavelength of 550 nm and a band width of 40 nm. This filter enhances the image of the red cells and improves the 
signal to noise ratio, and the filter was selected on the basis of a spectro-photometer measurement, which indicates 
that red blood cells have increased absorption of light In the corresponding wavelength range. 
[0050] The camera 44 was focused using a piece of glass printed with special patterns. These patterns are dark 
vertical lines with different sizes and widths as shown in Figure 6A If the camera is In focus, the signal profile of the 
pattern image Is a square wave, as shown in Figure 6B. If the camera is out of focus, me signal profile looses the sharp 
edge, as shown in Figure 6C. The pattern signal is derived, and the optimal focus is reached when the maximum 
derivative vaJue is obtained. 

[0051] In this embodiment of system 10 that has been actually reduced to practice, light source 14 includes two 
constant fluorescence tubes 36a and 36b (manufactured by Phillips, PL-S, 7-W), a diffuser 38, and a neutral density 
filter 40. As particularly shown in Figure 2, one fluorescence tube 38a was mounted in the front of the cassette, and 
the other fluorescence tube was located upward and rearward of the cassette. The neutral density filter 40 is located 
below the fluorescence tube 36b, and this filter Is used to reduce the amount of light transmitted to the cassette from 
tube 36b. The diffuser 38 is located parallel to and approximately 1 .0 mm forward of cassette. 
[0052] Figure 7 Is a block diagram illustrating processing subsystem 20 in greater detail. In this subsystem, the 
electric signals from the pixel array in camera 44 are conducted to preprocessor 56, which may be, for example, an 
image processing board made by Euresys S A of Belgium. This image processor then converts the electric signal from 
each pixel of array 42 into a respective one digital data value and stores that data value at a memory location having 
an address associated with the address of the pixel that generated the electric signal. The electric signals being trans- 
mitted to Image processor 56 may be identified in any suitable way with the specific pixel that generated the signal. 
For Instance, the signals from the pixels of array 42 may be transmitted to the image processor in a given, timed 
sequence, and a clock signal may be transmitted to the image processor from the camera to identiiy the start, or 
selected Intervals, of that sequence. Alternately, each signal transmitted to the image processor may be provided with 
a header or another data tag identifying the particular pixel that generated the signal. 

[0053] "me Euresys image processing board consists of 1 MB memory. As shown in Figure 8, the memory is divided 
into four quads: QAU, QAD, QBU, and QBD. Each quad contains a frame of 61 2x512 pixels. The source Image data, 
S, Is located In one quad QAD, and Quad QAU contains two fixed masks used tor covering the two columns In the 
later Image processing. Quad QBD is used for a procedure referred to as top-hat processing, discussed below, and 
Quad QBD is used for temporary operation. 

[0054] The data values stored In image processor 56 are available to main processor 60, which is connected to the 
image processor to obtain data values from and to transmit data values to that image processor. As explained in greater 
detail below, processor 60 Is programmed to process and to analyze the data values stored In the Image processor to 
identify the agglutination pattern, if any, In the test sample being analyzed. 

[0055J Preferably, main processor is, or is a component of, a personal computer also havl ng keyboard 62 and terminal 
64. Keyboard 62 is connected to processor 60 to allow operator input thereto, and terminal 64 is used to display visually 
data or messages being input into the processor. In addition, monitor 68 may be connected to processor 58 to produce 
video images from the data value stored in the processor or In image processor 56. For example, the S data values 
may be transmitted to monitor 66 to produce thereon an image of the real image produced on pixel array 42. Other 
sets of data values may be transmitted to the monitor to produce refined or processes images of the real image. Printer 
68 may be connected to processor 60 to provide a visual, permanent record of selected data values transmitted to the 
printer from the processor. 

[0056] As will beunderstoodbythoseof ordinary skill in the art, subsystem 20 may be provided with other or additional 
input or output devices to allow an operator or analyst to interact with processors 56 and 60. Also, the Individual 
components of subsystem 20 are conventional and wel l-known by those of ordinary skill in the art. For example, mon iter 
66 may be a high resolution color monitor; and, as discussed above, processor 60 may be a personal computer, and 
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image processor 66 may be an Image processing board made by Euresys SA of Belgium. 
[0057] With reference again to Figure 1 , storage means 24 is located adjacent holding means 12 and is provided for 
holding a multitude of test samples, and preferably indexing means such as a stepper motor is provided for moving 
the storage means through a series of positions to align each of the test samples held therein with the holding means. 
5 The storage means 24 shown in Figure 1 is particularly designed for holding cassettes 80, and the storage means 
forms a multitude of channels or slots 24a for holding those cassettes. The indexing means moves this storage means 
24 so as to align each of the channels 24a with the elongated channel 34a of frame 34, allowing the cassettes to be 
slid from the storage means and into that frame. 

[0058] With the preferred embodiment of system 1 0 shown in Figure 1 , storage means 24 comprises a rotatable 
w carousel including a rotatable base and a multitude of compartments. Each compartment forms a respective one of 
the channels or slots 24a, and each of these slots extends along a radius of the carousel. Further, the indexing means 
may comprise a stepper motor, and each time the motor is actuated, the motor moves the carousel so as to align one 
of the slots 24a with channel 34a of frame 34. This stepper motor may be operated, for example, to rotate carousel to 
align one slot 24a at a time with channel 34a, in a clockwise or counterclockwise sequence around the carousel, 
w Alternatively, the stepper motor may be provided with a programmed, or programmable, controller that operates the 
stepper motor to align slots 24a with channel 34a according to that program and in an order that may depend on a 
multitude of variable factors. 

[0059] Waste receptacle 26 is provided for receiving the test samples from holding means 1 2 afterthe desired Imaging 
has been completed. For example, the waste receptacle may be a container located below and adjacent the output 
20 end of channel 34a of frame 34, and positioned so that the test samples that are slid out from channel 34a fall into 
receptacle 26 under the force of gravity. 

[0060] Transport subsystem 22 is preferably provided to move test samples, particularly cassettes 80, into and then 
from holding means 12, specifically frame channel 34a. More particularly, with reference to Figures 1 , 9, and 1 0, support 
means 64 supports mover 66 for sliding movement between carousel 24 and waste receptacle 26 and over frame 34. 

25 | n use, mover 66 is positioned over the carousel, and as the carousel rotates to align a cassette with frame slot 34a, 
that cassette is moved into engagement with the mover. The mover then slides the cassette from carousel 24, into 
frame 34 and into a position directly forward of pixel array 42. After the desired imaging of the test sample is completed, 
the mover 66 is operated to slide the test sample through the output end of channel 34a and into waste receptacle 26. 
Alternatively, depending on the results of the analysis of the test sample, that test sample may be moved back into 

30 carousel 24, or to another location where the test sample may be sto red, for example, for further tests or for analysis 
by an operator. 

[0061] With particular reference to Figures 9 and 10, support means 64 includes a horizontal bar 92; and this bar 
extends from a position directly over carousel 24 to a position directly over waste receptacle 26, and bar 92 is supported 
in any suitable manner. Mover 66, in turn, is supported by and is mounted on bar 92 for sliding movement therealong, 
35 and a suitab te motor or motors (not shown) are provided to operate the mover. Mover 66 may be operated in response 
to electric signals received from sensors or timers or both, to move the test sample in the desired manner. Alternatively, 
the mover may be controlled by a programmed, or programmable, processor that operates transport subsystem 22 in 
a predetermined manner and according to a multitude of variable factors. 

[0062] Preferably, each cassette 80 Is provided with a bar code 66 identifying selected data about the cassette, and 
40 bar code reader 30 is provided to read the bar code on each cassette and to transmit the data thereon to processor 
60. For example, the bar code on the cassette may identify the cassette type, the date of manufacture of the cassette, 
and a recommended expiration date for the cassette. The bar code may include other data that identify the cassette 
manufacturer as well as the time and place of manufacture. As shown in Figure 1 , the code reader, which may be a 
standard bar code reader, is preferably located between storage rack 24 and frame 34 so that the reader scans the 
45 bar code on each cassette as the cassette is being transferred from the storage rack and into the frame 34. As an 
option, if the bar code 66 does not properly identify all the selected data, system 1 0 may be operated so that there is 
no processing of any image data from the cassette 80. For example, this may be done by not producing any Image of 
the cassette on pixel array 42, or if an image is produced, by not processing that image. 

[0063] In the operation of system 10, a multitude of test samples are placed in carousel 24, and the carousel is 
so rotated to align a selected one of the slots 24a with channel 34a. Then, mover 66 slides the test sample in that selected 
carousel slot, into the desired position in frame 34, and illumination means 1 4 then directs a beam of light through the 
test sample and onto pixel array 42. Cassette 80 may Include positioning marks 88 between the columns 82, or else- 
where on the cassette, to help align the cassette in frame 34; and system 1 0 may be operated so that, if the cassette 
does not have any such positioning marks, or if the marks are not properly aligned in frame 34, the cassette is rejected 
ss or there is no analysis or processing of the cassette. 

[0064] Each pixel of array 42 generates a respective one electric current having a magnitude representing the in- 
tensity of the light incident on that pixel; and these output currents are converted to digital data values, referred to as 
gray values or as the S values, and stored in image processor 56. Preferably, frame 34 is then rotated 180°, and 
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illumination means directs another light beam through the test sample to produce a further image of the test sample 
on the pixel array. Each pixel of array 42 generates another respective one electric current having a magnitude repre- 
senting the intensity of the light of the second image that is incident on the pixel. These output currents are converted 
to a second set of digital data values, which are also stored in the image processor. These two images of the test 

5 sample that are produced on the pixel array are referred to as the front and back images, respectively. 

[0065] Processing subsystem 20 then analyzes the images produced on the pixel array, in a manner discussed in 
detail below, to classify the particle patterns in the test sample, and on the basis of that classification, to classify the 
reaction between the reagent and the blood cells in the test sample. After the image processing is complete, mover 
66 may be used to slide the test sample into waste receptacle 26. Alternatively, if processor 60 determines that the 

10 test sample should receive further analysis or, for some reason, should be specifically brought to the attention of a 
human operator, then the test sample may be earned, by mover 66, another mechanism, or an operator, to a separate 
holding area. 

{0066] In the meantime, carousel 24 is rotated to align a second carousel slot with frame channel 34a; and once 
mover 66 Is available, that mover may be used to move the test sample from that second carousel slot into the frame 
13 channel. The desired image or images of that second test sample are produced and then processed to classify the 
reaction between the blood cells and the reagents in the test sample. 

[0067] The above procedure may be continuously repeated until stopped by an operator, or an automated controller 
may be provided to stop the procedure In accordance with a predetermined program. During the operation of system 
1 0, new test samples may be placed In carousel 24 either by an operator or by a suitable mechanism. 

so [0068] System 1 0 is particularly well suited for use in an automated solution testing system or instrument. For ex- 
ample, a blood analysis system or instrument In which system 10 may be used, is disclosed in contemporaneously 
filed patent application No. , for "An Automated Blood Analysis System", the disclosure of which is 

herein incorporated by reference (claiming priority from USSN 075303, Attorneys Ref:/P12278EP). 
[0069] As previously mentioned, when the test sample is held in a column 82 of a cassette 80, the number, size, and 

2s distribution of particles in the column is an indication of whether an agglutination reaction occurred In that column and, 
if so, of the strength of the reaction. Conventionally, the reaction is classified as negative (if no reaction occurred) or 
as positive (if a reaction has occurred), and If positive, the reaction is further classified as a class +1 , +2, +3, or +4 
reaction depending on the strength of the reaction. 

[0070] Rgures 11 A through 11 E illustrate these five types of reactions -negative, class +1, class +2, class +3, and 
so class +4, respectively- in a CAT using cassettes 80 of the type shown in Figures 3 and 4. With reference to Figure 
1 1 A, in the case of a negative reaction, the red blood celts do not agglutinate and, during centrifuging, those cells pass 
to the bottom of the column and form a pellet 1 02 at that bottom. In a weak, or class +1 , positive reaction, some of the 
blood cells agglutinate and form a relatively small number of small agglutinated particles 104; however, most of the 
red blood cells do not react. During centrifuging, agglutinated particles become distributed in the lower half of the 
35 micro bead column, and the un reacted red blood cells pass to the bottom of the column and form a pellet 1 06 thereat 
that is slightly smaller than the pellet 1 02 formed in the case of a negative reaction. 

[0071] In a class +2 reaction, which is slightly stronger than a class +1 reaction, a larger percentage of the red blood 
celts agglutinate and the agglutinated particles that form are larger; however, an appreciable number of the red blood 
cells still do not react With reference to Figure 11C, during centrifuging, the unreached blood cells pass through the 

*> column bottom and form a small pellet 110, and larger agglutinate particles 112 become distrfcuted throughout the 
length of the column of mlcrobeads. In a class +3 reaction, most or virtually all of the red blood cells agglutinate and 
the agglutinated particles that form tend to be larger than those that form in a class +2 reaction. As shown in Figure 
1 1 D, even after centrifuging, most of the agglutinated particles 114 remain in the upper half of the bead column. In a 
class 44 reaction, all, or virtually all, of the red blood cells agglutinate and form large agglutinates 11 8 at the top of the 

45 glass beads. These beads prevent the agglutinates from passing downward during centrifuging so that, after centri- 
fuging, the agglutinates remain above the beads, as shown in Figure 11 E 

[0072] The reagent and the glass beads in column 82, as well as the body of cassette 80, are substantially trans- 
parent; however, the agglutinated particles and the red blood cells are only partially transparent Hence, in the operation 
of system 1 0, when light is transmitted through column 82 and onto pixel array 42, the portion of the light that passes 
so through the agglutinated particles and the red blood cells is incident on the array at a relatively low Intensity, while the 
rest of the light passing through column 82 is incident on the array at a higher intensity. Accordingly, in the image of 
column 82 that is formed on pixel array 42, the agglutinated particles and the red blood cells appear as gray or shadow 
areas relative to the rest of the image. 

[0073] With reference to Figure 12, the preferred procedure for processing the Image produced on pixel array includes 
& four programs: (1) image acquisition, {2) column detection, (3) feature extraction, and (4) reaction classification. The 
image acquisition program relates to the management of and the interface between camera 44 and preprocessor 56, 
and the column detection program identifies the borders of the columns that appear on the pixel array. The feature 
extraction program extracts information related to the agglutination reactions from the source Image and translates 
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that information into quantitative data. The reaction classification program separates the reactions into different classes 
on the basis of the extracted features. 

[0074] The first step in the image acquisition program is an initialization step, in this step, the video memory is cleared, 
several variables, discussed below, are set to associated values, and camera 44 is placed in checked mode. Then, 

5 after a cassette 80 is positioned in front of the camera by the transport subsystem 22, the image acquisition program 
sends a synchronization signal to the camera, and the camera shutter operates so that an Image of the cassette is 
produced on pixel array 42. The image data values are then obtained by the Image processing platform and converted 
into digitized signals that are stored in the fanage processor. To optimize the source image signals, the gain and offset 
of the electronic board is preferably adjusted with a gray scale so that the gray level of a black strp is zero, and the 

io gray level of the glass beads Is 1 70. 

[0075] After the triage acquisition program is completed, the column detection program begins. The first step in this 
program is to search tor the positions of the two columns in the Image frame, and in particular, to search for the left, 
right, and bottom edges of the two columns on the pixel array. This is done by using the fact that, due to the diffraction 
of light by those edges, those edges appear on the pixel array slightly darker than the immediately adjacent areas. 

13 More specifically, with reference to Figure 13, the program creates two rectangular areas on the pixel array to cover 
the regions where the two columns are expected to be located. The size of each area may be, for example, 220 by 
600 pixels, and the position of each rectangle is determined by preset x and y coordinates of the upper left comer of 
the rectangle. These parameters are listed below: 



Name 


\fcluo 


Description 


COLJ-OCAJWIDTVI 


220 


width of the frame 


CDL_LOCA_HEIGHT 


500 


height of the frame 


COL1_LOCA_ORGX 


0 


x-coordinate of the left column 


COL2J.OCA-ORGX 


292 


x-coordinate of the right column 



[0076] The Y-coordinates for the upper left comers of both areas are zero. 

[0077] To detect the left and right edges of the columns, the program then generates three small areas within each 
30 rectangular window, as shown in Figure 14. The positions of these areas are defined by the following coordinates: 



Name 


Value 


Description 


UPPER_BORDER_LENGTH 


25 


segment length 


UPPER_BORDER_THICKNESS 


199 


projection thickness 


UPPER_BORDER_Y 


160 


y-coordinate of the middle of the area 


LEFT_BORDEFLX 


30 


x-coordinate of the middle of the left area 


RIGHT_BO RD ER_X 


190 


x-coordinate of the middle of the right area 


BOTTOM_BORDERJ_ENGTH 


45 


segment length 


BOTTOM_BORDER_THICKNESS 


19 


projection thickness 


BOTTOM _BORDER_Y 


435 


y-coordinate of the middle of the area 



45 

[0078] The two left and right symmetric areas are used to-detect the left and right side borders of the column. The 
gray values in the blocks are projected into two one-dimension vectors. At each point on each vector, a projected value 
is obtained by adding the gray values at all pixels in the corresponding vertical line through that point. The length of 
the vector is defined by the UPPER_BORDER_LENGTH. These values are then derived and the maximal derivative 
so Is obtained. This maximal derivative corresponds to the maximal variation of the gray scale, and on the basis of its 
location, the edge of the column is determined. The edge of the column is on the vertical line segment extending 
through the pixel having this maximal derivative. 

[0079] It should be noted that it is not necessary to practice the present invention in its broadest sense that the left 
and right edges of each column be found independent of each other. For instance, as an alternative, one of those 
55 edges may be found; and then the other edge of the column may be considered as being on the vertical line segment 
parallel to and spaced a preset distance from that found edge, either to the left or to the right thereof depending on 
whether the initially found edge is on the right or left edge, respectively, of the column. 

[0080] Once the left and right borders of each column are found, the column detection program then searches for 
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the bottom border of the column. This search also utilized the fact that, due to the diffraction of light by that edge, that 
edge appears slightly darker on the pixel array than the immediately adjacent areas. More specifically, once the x- 
coordinates of the two side borders are found, the centerline of the column is determined and used as a reference to 
locate the third, bottom rectangular area shown in Figure 14. This area, in turn, is used to locate the bottom edge of 

5 the column by means of a procedure analogous to the procedures used to detect the left and right edges of the column. 
In particular, the gray values In the block are projected onto a one-dimensional vertical vector. At each point on the 
vector, a projected value is obtained by adding the gray values of all the pixels In the corresponding horizontal line 
through that point. These values are then derived and the maximal derivative is obtained. This maximal derivative 
corresponds to the maximal variation of the gray scale, and the bottom edge of the column is considered to be on the 

10 horizontal line sep/nent extending through the pixel having this maximal variation. 

[0081] Once the center line and the bottom point of each column are determined, a smaller window Is superimposed 
over each column. This window which Is shown in Figure 1 6, has the same width as a column; and by matching the 
center and the bottom of the window with those of the column detected above, the window Is fitted onto the column. 
Thus, the location of each column is fully determined. 

is [0062] After the column detection program Is completed, the feature calculation program begins. As an initial step 
In this program, various reference values are determined for subsequent use; and preferably, a respective set of such 
reference values Is determined for each of the two columns illuminated on the pixel array. More particularly, the program 
selects three reference areas or regions for each column. As shown in Figure 15, one region is located In the bead 
area inside the column, a second region is located above that bead area, and the third region is located outside the 

50 column. 

[0083] After the desired reference areas are defined, the program determines values for the variable R modus , R mQX1 
Rrnin' Router ^obove- ' n particular, R TTwdu3 is set equal to the most frequent gray value in the reference region In the 
bead area inside the column. This reference value is a characteristic of the glass beads in column and is used as a 
threshold value in various subsequent processing steps. In addition, is set equal to the maximum gray value in 
28 the reference region in the bead area inside the column, and R^ is set equal to the minimum gray value in that inside 
the column. is set equal to the average gray value in the reference area outside the column, and is set 
equal to the average gray value in the reference area above the glass beads. 

[0084] Next, the program begins to extract features related to the reaction that occurred in column 82. The features 
extracted include (1) parameters related to the cell pellet shape; (2) the red cell agglutinates in the column; and (3) the 

so side to side balance of red cells in the column. 

[0085] The cell pellet in the bottom of the column is first obtained by applying a global threshold in the V shape region 
of the column. The default threshold value is 54% of R modus . In particular, the number of pixels in the V-shaped region 
of the column that have S values less than 54% of R^^ is determined. The size of the pellet is calculated on the 
basis of the number of pixels inside the pellet area. If the size Is larger than a given number, such as 200 pixels, the 

38 cell pellet is considered significant and the parameters related to the location of the cell pellet are determined. These 
parameters are illustrated in Figure 1 6 and are defined as follows: 



Name 


Description 


teftx, lefty 


left-most point in the upper border 


rightx, righty 


right-most point in the upper border 


Ylimit 


lowest y-coordinate in the upper border 


pellety 


bottom-most point in the bottom border 


pelletx 


gravity center of the part below Ylimit 



[0086] On the basis of these coordinates, the position of the window is readjusted by matching the center line of the 
window with pelletx. 

59 [0087] To analyze the pellet shape, the upper border of the cell pellet is fitted with a linear line Y=a*bX. This line is 
determined as follows: 

[0088] Assume the upper border of the pellet is defined by a set of points 

(x,.y,).U1,N 

59 

where N = rightx = leftx - 8 (The fitting does not includes the four points near the edge on each side). The error of the 
approximation line is defined as 
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N 
i=l 

5 

[0089] To minimize this error, the coefficient a and b have to be 



NS_,-S lt S w 



15 

where 



20 N N 



N N 

Sy=Tyi Sxx*Z x i 2 
1=1 & 

[0090] The residual of a pellet is calculated as 



35 



Residual = 

40 




I(yt 2 -Yi2) 
B 

N 



[0091] On the basis of the above computation, three feature variable are obtained Including the size of the cell pellet, 
the slope of the cell pellet, and the residual value. These variables are subsequently used to classify the agglutinate 
pattern. 

45 [0092] After these variables are obtained, a fixed mask, shown in Rgure 1 7, is used to cover the whole column area. 
This mask has the same width and shape as a column, and the mask Is stored In a file and loaded Into one memory 
frame on the Euresys board during image analysis. By matching the center and the bottom of the mask with those of 
the detected column, the mask is fitted onto the column. 

[0093] The next step of the program is to extract the number of red cell agglutinates and their distribution in the 
so column. For this purpose, the bead column is divided into five zones, shown in Rgure 16, referred to as the positive 
zone, the negative zone, and intermediate zones 1 , 2, and 3. Generally, the positive zone is defined so as to contain 
the surface area on the top of the glass beads, and for example, it may be defined as the area above the line = 
80. The negative area is defined as the cell pellet area in the bottom of the column. If there is no cell pellet, then there 
is no negative area. The bead area between the positive and negative zones is divided into three areas of equal height 
58 to form the intermediate zones 1 , 2, and 3. The size of the three intermediate zones is determined by Y^ and Y ifrnfc 
and the height, H, of each zone is given by the equation: 
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5 If there Is no cell pallet and, thus, no negative area, then Y flmk is defined as 40 pixels above the bottom of the column. 
[0094] The next step in the program is to determine the number of pixels in the positive zone that are illuminated at 
an intensity below a given value, and for example, that given value may be 54% of R^o*^ As discussed in greater 
detail below, the number of such pixels in the positive zone is used to determine if a strong positive reaction, such as 
a +4 reaction, occurred in the column. 

io [0095] Then, the number of red cell agglutinates located In each of the intermediate zones is determined by means 
of an operation referred to as a top-hat operation and that finds the agglutinates on the basis of the local variation of 
the gray values. A top-hat operation Is based on two basic operators: dilatation and erosion. The dilatation Increases 
the size of an object and the erosion reduces the size of an object, and an erosion followed by a dilatation on an object 
is usually called as an opening operation. The top-hat transformation of an image, denoted h, is defined as: 

13 

h = f-(fob) 

where f Is the Input knage and b Is the structuring element function used by the opening (o). In the present application, 
so the structuring element is kernel 7x7, and Figure 19 shows an example of the top-hat transformation to a line slice of 
an image. After the dilation-erosion operation, a global cut-off is applied with a value equal to 12% of R modus . The 
number of pixels in each intermediate zone having gray values, after the top-hat transformation, greater than 12% of 
RjTOdu, Is determined. The parameters are then calculated by counting the number of pixels above the cutoff value in 
the zones 1 , 2, and 3, and they correspond to the amount of red cell agglutinates in these zones. 
ss [0098] The feature calculation program then examines the balance of agglutinates between the left and right halves 
of the column, and in particular, between lower portions of the left and right halves of the column. The preferred area 
of the column that is used to determine that balance is shown in Figure 20; and with reference thereto, that area extends 
upward for a given number of pixels, such as 120 pixels, from the lowest point (Y lhnt ) of the upper border of the cell 
pellet. The center line of the column is used to separate the area into two parts, as shown in Figure 20. The number 
so and location of red cells In the column and in the ceil pellet were previously determined during the top-hat procedure 
and the global threshold, and this data are used to determine the number of red blood ceils on the left and right sides 
of the column . The balance of agglutinate between the left and right halves of the column is considered as the difference 
between the numbers of red blood ceils on the left and right sides of the column. 

[0097] As discussed above, preferably two images, referred to as the front and back images, of each column are 
33 produced on the pixel array. The front Image is produced, the column is then rotated 180°, and then the back image 
is produced. Preferably, values for each of the above-described parameters are obtained for each of the front and back 
images of the column, and then the two values for each parameter are summed. 

[0098] Thus, the feature extraction program calculates the following features for each column: (1 ) the agglutinated 
red cells in the positive zone; (2) the cell agglutinates in intermediate zone 1, zone 2, and zone 3; (3) the size, slope, 
40 and residual of the cell pellet, and (4) the balance of the agglutinates between the left and right sides. These include 
a total of eight parameters. 

[0099] Once values for the above-discussed parameters are obtained, the reaction grading program then uses these 
parameter to classify the reaction that occurred in the column into different classes. Generally, the program classifies 
the reaction as positive or negative; and if positive, as a class +1, +2, 43, or 44 reaction. In addition, the program is 
43 also capable of Identifying a column as having an intermediate reaction, of identifying an empty cassette, and of indi- 
cating if a cassette cannot be read or if a column cannot be found. 

[0100] The classifier is a linear decision tree on the basis of the Mahalanobis distance. This method is descrbed In 
detail in the book "Methods Statistiques de Reconnaissance des Formes 11 by G. Gaillat (Ecole NationaJe Superieure 
de Techniques Avancees). A simple mathematical definition of different calculations for the measurement of the sep- 
so arability between classes is given below. 

Discriminate Analysis: 

[0101] Consider a set of N elements belonging to K classes. Each of the K subsets has N 1f N 2 , N k points, and 

55 is noted as 

X*={X|«> 
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with n=[1 ..NJ and k=[1 ..K] and element of subset (I, number of features). 
[0102] Tne center of gravity of this subset is defined as 



1 N1 

* n=1 



and the covariance matrix as 



N1 t 

n=1 



[0103] Thecenterof gravity X and the covariance matrbcT of the whole set are related to those of the subsets)^ and T k 



K 

X" it 2 N k xX K 



k=1 



K K 

k=1 k=1 



[0104] Now we define 



K 

k=1 

which is the sum of Covariance matrixes of different classes, termed bs the intraclass covariance matrix, and 

K t 

W=v£N k (X k -X)(X k -X) 1 

which is the covariance matrix of a set constituted by K points X* with coefficients N k , termed as the i nterclass covariance 
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[0105] Accordingly we define two additional terms the intraclass variance, v, and the interdass variance, w, as follows: 

K N k 

v = trace(V) =X X IXkn^kl 2 
k=1 n=1 



which measures how the elements belonging to one class are grouped around their center of gravity. The smaller it Is, 
the nearer the elements are to the center of gravity. If the intraclass variance was equal to 0, the elements of a class 
would be concentrated on their center of gravity. The interdass variance, w, is defined as follows: 

K 

W=trace(W)=XlX k -Xl 2 
k=1 

which is the dispersion between classes. The greater it is, the more dasses are separated from each other. If all centers 
of gravity aggregated to their center X, then the interdass variance would be equal to 0. 

[0108] In pattern recognition, the ratio w/v can be used as a measure of separability between dasses. If it is great, 
then classes form compart sets and are all separated from each other. In contrast, if this ratio is small, it will be difficult 
to distinguish classes. 

[0107] The purpose of discriminate analysis is to project a set of data into a J-dimensional sub-space in a way that 
the different classes are most separated. This corresponds to maximize the ratio of the interdass variance w over the 
interdass variance v to be maximum in the sub-space.. 

[0108] If the data set is projected into a one-dimensional space with a unitary vector u, then the intraclass and 
interdass variances of the projected set can be calculated 

v u =uVu 
w u =u*Wu 

where V Is the interdass covariance matrix and W is the intradass covariance matrix Consider the ratio 




The maximum of this ratio can be found when the gradient 

grad(r u ) = \ x (v u grad(w u )-w u grad(v u ) 
V 

becomes zero. That is, the vector grad(v u ) and grad(w u ) are co-linear: 

grad(w u )=Xgrad(v u ) 

or 



13 



EP0637744B1 



Wu=XVu 

where X is a parameter. If V can be inverted, then 

5 

V" 1 Wu=Xu 

This equation shows that the ratio r u is maximum when the direction of the projection axis is defined by the eigenvector 
10 associated to the highest eigenvalue of matrix V* 1 W. This can also be demonstrated to be true for the J-dfrnensional 
sub-space. 

[0109] To separate the data Into various classes, the feature data is first projected into a sub-dimensioned space to 
maximize the separability of the data. A classifier has been developed to separate the data in the sub-drnensional 
space. 

13 

Mahajgnobte Distance; 

[0110] If a data set consists of K classes (w,, w^.., and has Gaussian distribution, then for each point X, the 
probability of X belonging to class w k can be written as 

20 

f*c<X) = P<w k )'f(X)w k ) 



with f wlc (X) is a probability of X belong! ng to W k ; is the probability of w k in the whole data set; ftXJwJ Is a conditional 
28 probability of X given that it belongs to w k . The classical Bayesian approach for pattern recognition is to select a class 
that maximizes WX). 

[01 1 1] When the samples obey the Gaussian distribution , the above approach is equivalent to search the maximum of 

30 9kW - - (X-X k ) VPWk) + 0°g(detCT k )) - 2°9(P(W k ))] 

[0112] The first term can be Interpreted as a square of a distance between X and the center X^ called a Mahalanobb 
distance. The second term Is a correction term dependent on class k but not on X. A set of surfaces defined by 

35 (X-jyhy 1 (X-X^ = constant 

constitues a group of concentric ellipsoids, with center X*, 

[0113] In the case that the projection space is two-dimensional, the function g k (X) can be written explicitly. The 
40 calculation is simplified by suppressing the corrective term if the equiprobability of the classes Is considered. 

[01 1 4] Assume the sample X is represented by the coordinates (x,y), the center of gravity of class k is (X^ Y*) . and 
the inverse of the covariance matrix of class, kT^ 1 , is 



T k,11 T k>12 
Jk,21 T k|2 2_ 



50 



55 



which is symmetric T k12 =T ki21 . Thus, assume 
Gfcfcy) = -g^X) and it can be written as 



G k(x«y) = T^ii^) 2 + 2*T KA2 (x-x k ) (y-y k ) +T k(22 (y-y k ) 2 



Gkfcy) te a second degree polynomial, and we want to find the minimum G k . 
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[0115] The samples are graded into different classes on the basis of a linear decision tree. This program classifier 
first separates the samples into two principal groups. One group, Group I, contains the classes +1 , +2, +3, and +4 
reactions, and the other group, Group II, includes 0 and very weak positive reactions. The classifier identifies these 
following classes: 



Class 


Description 


0 


Negative reaction 


1 


Positive reaction 


2 


Positive reaction 


3 


Positive reaction 


4 


Strong positive reaction 


-2 


Cant read cassette or column not found 


-4 


Intermediate reaction 


-5 


Empty cassette 



20 [0116] Figure21 shows a flow chart summarizing the global structure of the classifier. The feature data used in each 
decision are shown in the Figure and are detailed as follows: 

Empty Column : To determine if a column is empty, the total red cells in a whole column, including the negative zone, 
positive zone, and three intermediate zones, are summarized. If the value is less than a given number such as 500, 
the column is graded as an empty column. That is 

25 Sum_whole=PPos+PNeg+-Zone1+Zone2+Zone3 
if (Sum_whole<500) l then {empty column} 
Separation into two groups: The negative class reactions are separated from the majority of the positive class reactions 
on the basis of the size of the cell pellet and the sum of the agglutinates in zones 1 , 2, and 3. That is: 
if (PNeg<500) or (Sum_ J Zones>800), then positive reaction {1 , 2, 3, 4) 

so else negative reaction {0,1} 

Classification of {1 ,2,3,41: The positive reactions are further separated into class +1 , +2, +3, and 44 reactions on the 
basis of the distribution of agglutinates In the column. The distribution of the agglutinates Is represented by the five 
features: PPos, Zonel, Z6ne2, Z6ne3, and PNeg. Table 1 lists the average feature data of four types of positive reac- 
tions. The results indicate how the feature data vary among positive reactions. 

35 

Table 1 : 



Average feature data of different reaction classes. 



Features 


Class 1 


Class 2 


Class 3 


Class 4 


PPos 


22 


304 


2183 


3860 


Zone 1 


358 


1238 


1745 


259 


Zone 2 


302 


1034 


700 


43 


Zone 3 


359 


786 


270 


58 


PNeg 


2085 


764 


26 


19 


Number of samples 


281 


328 


173 


45 



fl>1 1 7] The classification is done by Mahalanobis distance, which is able to separate correctly the different types of 
reactions. 

Classification of {0,1}: The separation of these two classes uses the following features: (0 the sum of agglutinates in 
zones 1 , 2, and 3, (ii) the slope and (Hi) the residuals of the cell pellet upper border, and (iv) the side to side balance 
of red cells. In order to Increase the separability between the two classes, the discriminate analysis Is applied. The 
above four features are projected into one dimension space. The variation of the separability Is significant. Before the 
projection, the separability is equal to 0.70 and after projection, 1.38. This means that the elements of each class are 
more regrouped around their center of gravity and the distance between the two classes is increased. The projection 
is calculated as following: 
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Projection = 0.78 x Agglutinates + 0.48 x residuals + 0.36X slope + 0. 13 x balance 

[011 q The coefficients are calculated by discriminate analysis. They show the importance of each feature for the 
projection. 

[0119] The limit between classes is estimated by Mahalanobis distance. The result may also include an indeterminate 
class. It may be defined by the difference between the two Mahalanobis distances calculated for both classes, if the 
absolute difference is below 1.2, then the sample is classified as a questionable reaction. This third class is on the 
boundary between classes 0 and 1 . 



Claims 

1. A method for analyzing a solution for an agglutination pattern, comprising: 

producing an illuminated Image of the solution on an array of pixels; 

assigning to each pixel on the illuminated Image, a data value representing the Intensity of the illuminated 
Image on the pixel; 

characterized In that the method further Includes the step of processing the data values according to a 
predetermined program to determine whether an agglutination pattern is present in the solution and, if an agglu- 
tination pattern is present, to identify the pattern as belonging to one of a multitude of predetermined classes, the 
processing step including the steps at 

i) processing the data values to determine if celts are present in the column, 

ii) processing the data values according to a first routine to classify the solution preliminarily as being in one 
of two groups, 

Hi) if the solution is classified in a first of the two groups, then processing the data values according to a second 
routine to determine whether an agglutination pattern is present in the solution, and 
iv) if the solution is classified in a second of the two groups, then processing the data values according to a 
third routine to classify the agglutination pattern into one of a first set of the predefined classes. 

2. A method according to Claim 1 , wherein the predetermined classes include: a negative reaction, class, and a week 
positive reaction class, and the step of processing the data values according to the second routine includes the 
step of distinguishing between the solution belonging in the negative reaction class and the weak positive reaction 
class. 

3. A method according to Claim 2, wherein the predetermined classes further Include other positive reaction classes, 
and the step of processing the data values according to the third routine includes the step of distingu ish ing between 
the solution belonging In the strong positive reaction class and the other positive reaction classes. 

4. A method according to Claim 1 , wherein the solution is in a container, and further comprising: 

if the container has preselected alignment marks, positioning the container to locate the alignment marks in 
preset positions to align the container with the pixel array, and omitting the processing step if the alignment 
marks are not located in the preset positions; and 

if the container does not have preselected alignment marks, omitting the processing step. 

5. A method according to Claim 1 , wherein the solution is in a column having a bottom and wherein: 

the step of processing the data values for the pixels include the step of processing the data values to determine, 
using a predefined set of variables, if a pellet of cells is located in the bottom of the column, the predetermined 
set of variables including the size of the pellet and the slope and shape of a top surface of the pellet. 

6. A method according to claim 5, wherein the column includes left and right halves, and each of said halves includes 
a number of blood cells, and wherein the predefined set of variables further includes the difference between the 
numbers of blood cells on the left and right halves of the column. 
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Patentansprtiche 

1 . Verfahren zur Analyse einer Losung auf ein Agglutinerungsmuster, umf assend: 

Herstellen eines beteuchteten Bilds der Ldsung auf einer Anordnung von BiWpunkten; 

Zuwelsen eines Datenwerts zu jedem Bilcfcunktauf dem beleuchteten Bild, der die Intensitat des beleuchteten 

Bilds auf dem Bildfeunkt darstelrt; 

dadurch gefeennselchnet, daS das Verfahren weiterhin dem Schritt von Bearbeiten der Datenwerts nach einem 
vorbestimmten Programm einschlieBt, urn zu bestimmen, ob eln Agglutinierungsmuster in der Losung vorhanden 
ist und, wenn ein Agglutinierungsmuster vorhanden 1st, urn das Muster als zu einer von einer Vielzahl von vorbe- 
stimmten Kiassen zugehdrig zu identifizieren, wobei der Bearbeitungsschritt die Schrftte einschlieBt von: 

f) Bearbeiten der Datenwerte, urn zu bestimmen, ob Zellen in der Saute vorhanden ist, 

ii) Bearbeiten der Datenwerte nach einer ersten Routine, urn die Losung voriaufig als in eine von zwei Gruppen 
geh5rig zu Idassifizieren, 

iii) wenn die Ldsung zu einer Ersten von den zwei Gruppen klassifiziert wind, Bearbeiten der Datenwerte nach 
einer zweiten Routine, urn zu bestfrnmen, ob ein Agglutinierungsmuster In der Losung vorhanden 1st, und 

iv) wenn die Ldsung zu einer Zweiten von den zwei Gruppen klassifiziert wlrd, Bearbeiten der Datenwerte 
nach einer dritten Routine, urn das Agglutinierungsmuster in Eine eines ersten Sets der vorbestimmten Kias- 
sen zu Idassifizleren. 

2. Verfahren nach Anspruch 1 , wobei die vorbestimmten Kiassen einschiieBen: Eine negative Reaktionsklasse und 
eine schwach positive Reaktionsklasse, und der Schritt von Bearbeiten der Datenwerte nach der zweiten Routine 
den Schritt von Unterscheiden zwischen der Losung, die zu der negativen Reaktionsklasse und der schwach 
positiven Reaktionsklasse gehdrt, einschlieBt 

3. Verfahren nach Anspruch 2, wobei die vorbestimmten Kiassen welter andere positive ReaktionsWassen einschiie- 
Ben, und der Schritt von Bearbeiten der Datenwerte nach der dritten Routine den Schritt von Unterscheiden zwi- 
schen der Ldsung, diezu der stark positiven Reaktionsklasse und den anderen positiven ReaktionsWassen gehdrt, 
einschlieBt. 

4w Verfahren nach Anspruch 1 , wobei die Ldsung in einem Behdlter voriiegt und welter umfassend: 

wenn derBehattervcrgowahrteAusricntungsnwWenjngen aufweist, Posrdonieren des Behalters, urn die Aus- 
richtungsmarkierungen in vorgewfihrte Positionen zu lokalisieren, urn den Behalter mft der Bildpunktanord- 
nungen auszurichten und Auslassen des Bearbeitungsschritts, wenn die Ausrichtungsmarkierungen nicht In 
den vorgegebenen Positionen lokalisiert sind; und 

wenn der Container kelne vorgewahften Ausrichtungsmarkierungen aufweist, Auslassen des Bearbettungs- 

■LLJ -I 111 __ 

scnrrns. 

5. Verfahren nach Anspruch 1 , wobei die Ldsung in einer Saule voriiegt, die einen Bo den aufweist und wobei: 

der Schritt von Bearbeiten der Datenwerte fur die Bifdpunkte den Schritt von Bearbeiten der Datenwerte ein- 
schlieBt, urn, unter der Verwendung eines pradefinierten Sets von Variablen zu bestimmen, ob ein Zeifeellet 
in dem Boden der Saule lokalisiert 1st, wobei das vorbestimmte Set von Variablen die GrdBe des Pellets und 
die Steigung und die Form einer oberen Oberflache des Pellets einschlieBt. 

6. Verfahren nach Anspruch 5, wobei die Saule linke und rechte Halften einschlieBt und Jede von den Halften eine 
Zahl von Blutzellen einschlieBt, wobei das prfidefinierte Set von Variablen weiterhin den Unterschied zwischen 
derZahl von Blutzellen auf den linken und rechten Halften der Saule einschlieBt. 



Revendlcatto ns 

1. Precede pour I'anaryse cfune solution en ce qui conceme un motif ©'agglutination, comprenant : 
- la production d'une image eclairee de la solution sur una matrice de pixels ; 
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['assignation a chaque pixel da I'image eciairee rfune valeur de donnees representant i'intensfte de I'image 
6clair6e sur le pixel ; 

caracter Ise en ce que le proc&J6 comprend, de plus, une etape de traftement dee valeura de donnees selon 
5 un programme predetermine pour determiner si un motif d'agglulination est present dans ia solution et si un motif 

tfagglutination est present, pour Identifier le motif comme appartenant a une dasse June plurality de classes 
predeterminees, retape de traitement comprenant les etapes suivantes : 

1 ) le traitement des valeurs de donnees pour determiner si des cellules sorrt presentee dans la colonne ; 

w 

2) le traitement des valeurs de donnees selon un premier programme pour classer la solution, de fapon pre- 
liminalre, comme etant dans un des deux groupes ; 

3) si la solution est classed dans un premier des deux groupes, le traitement des valeurs de donnees selon 
13 un second programme pour determiner si un motif d'agglutlnation est present dans la solution ; et 

4) si la solution est classee dans un second des deux groupes, le traitement des valeurs de donnees selon 
un troisieme programme pour classer le motif d'agglutlnation dans une class© d'un premier ensemble de clas- 
ses predeflnles. 

20 

2. Precede selon la revendication 1 , selon lequel les classes pr&Jeierminees comprennerrt : une dasse de reaction 
negative et une dasse de reaction positive faible, et i'etape de traitement des valeurs de donnees selon un second 
programme comprend une etape de distinction entre la solution appartenant a la classe de reaction negative et a 
la classe de reaction positive faible. 

25 

3. Precede selon la revendication 2, selon lequel les classes predeterminees comprennerrt, de plus, cTautres classes 
de reaction positive, et I'etape de traitement des valeurs de donnees selon le troisieme programme comprend 
retape de distinction entre la solution appartenant a la classe de reaction positive forte et aux autres classes de 
reaction positive. 

30 

4w Precede selon la revendication 1 , selon lequel la solution se tnouve dans un recipient, et comprenant, de plus : 

- si le recipient possede des reperes presetectionnes d'alignement, le positionnement du recipient pour placer 
les reperes rfallgnement dans des positions preetablies afin rf aligner le recipient avec la matrfce de pixels, 

35 et {'omission de I'etape de traitement si les reperes cf aJignement ne sont pas situ 6s dans les positions 

preetablies ; et 

- si le recipient ne possede pas de repere preselectionnd tf aJignement, ('omission de I'etape de traitement 

4> 5. Precede selon la revendication 1 , selon lequel la solution se trouve dans une colonne posseclant un fond, et selon 
lequel : 

- I'etape de traitement des valeurs de donnees pour les pixels comprend une etape de traitement des valeurs 
de donnees afin de determiner, a Paide d'un ensemble precJefini de variables, si une pastille de cellules est 
situee dans le fond de la colonne, rerssemble predetermine de variables comprenant la dfrnension de la pastil le 
et I'inciinaison et la forme d'une surface superieure de la pastille. 

Precede selon la revendication 5, selon lequel la colonne comprend des moities gauche et droite, et chacune 
desdites moities comprend un certain n ombre de cellules du sang, et selon lequel P ensemble predefini de variables 
comprend, de plus, la difference entre les n ombres de cellules du sang sur les moities gauche et droite de ia 
colonne. 
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FIG.6A 
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FIG.6B 
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FIG.6C 
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Image Acquisition 

( 1 ) Initialize Camera and Euresys Board; 

(2) Set Euresys Board Parameters; 

(3) Grabe Images; 

(4) Read & Write Images. 



Column Detection 

( 1 } Determine the Location of the Columns In 
an Image; 

(2) Generate window to cover column 



Feature Calculation 

(1) Extract Red Cell Agglutinates; 

(2) Extract Cell Pellet and Analyze theOQOOD 

Pellet Shape; 

(3) Estimate the Balance of Red Ceils In a 

Column. 



Reaction Grading 

( 1 ) Combine the Features; 

(2) Grading the Reaction on the Basis of 
the Feature Combination. 
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FIG. 13 

COLLLOCA.ORGX COL2_LOCA_ORGX 



512 PIXELS 




COL.LOCA 
HEIGHT 




COL.LOCA.WIDTH' 



512 PIXELS 



FIG. 14 

LEFT. BORDER.X RIGHT BORDER.X 



UPPER. 
BORDER _Y 



BOTTOM- 
BORDER _Y 




UPPER. BORDER. 
THICKNESS 



UPPER. BORDER. 
LENGTH 



BOTTOM. BORDER- LENGTH 



BOTTOM. BORDER. 
THICKNESS 



28 



EPO 637744 B1 



FIG. 15 
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GREY UNIT 
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